MASSY speaks English: adaptation and evaluation of a talking head
نویسنده
چکیده
This paper presents an extension of a talking head that was implemented to synthesize audiovisual speech utterances in German. A mapping of English to German phonemes and a subsequent refinement of the co-articulation model enables the system to generate English utterances. A modified rhyme test was carried out for evaluation in terms of intelligibility. Results show that the visualization increases the identification of isolated words from 27 % to 50 % when played with audio.
منابع مشابه
A comparison of German talking heads in a smart home environment
The authors describe a newly developed German Text-Toaudiovisual-Speech (TTavS) synthesis system based on the English speaking HeadZero. Targets of the control parameters of the talking head are generated by mapping of German phonemes to the originally English visemic blend shapes controls. The resulting German version of HeadZero and the German talking head MASSY were extended to generate audi...
متن کاملEnglish Talking Head Adaptation for Lithuanian Speech Animation
Visual speech animation plays an important role in human-computer interaction. To force already existing English Talking Head speech animation engine to talk Lithuanian, some modifications to the animation script were made. For this adaptation, the relation between English and Lithuanian languages was explored. To determine it, 30 3dimensional Lithuanian visemes were modeled using the calibrati...
متن کاملGeneration of Personalized MPEG-4 compliant Talking Heads
This paper studies a new method for three-dimensional (3D) facial model adaptation and its integration into a Text-to-Speech (TTS) system. The TTS System pronounces, in real time, English or Greek speech and simultaneously animates the adapted face model, thus simulating a natural talking face. The 3D facial adaptation requires a set of two orthogonal views of the user’s face with a number of f...
متن کاملWhat topic do you want to hear about? A bilingual talking robot using English and Japanese Wikipedias
We demonstrate a bilingual robot application, WikiTalk, that can talk fluently in both English and Japanese about almost any topic using information from English and Japanese Wikipedias. The English version of the system has been demonstrated previously, but we now present a live demo with a Nao robot that speaks English and Japanese and switches language on request. The robot supports the verb...
متن کاملEnglish Language Teaching Material Development
The goal of language programs is to utilize language for effective communication. Due to the needs, interests, and motivations of language learners, they may show individual differences in their lan- guage learning. Materials used in language programs can be instructional, experiential, elucidative, or exploratory in that they can inform learners about the language, provide experience of the la...
متن کامل